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SPECIFICATION 

1. Title of the Invention: 

DATA COMPRESSION APPARATUS, DATABASE SYSTEM, DATA 
COMMUNICATION SYSTEM, DATA COMPRESSION METHOD, STORAGE 
MEDIUM AND PROGRAM TRANSMISSION APPARATUS 

2. Detailed Description of the Invention: 
[Field of the Invention] 

The present invention relates to a data compression method 
for compressing document data written in a tree local 
language, such as XML or ASN.l. 

[Background Art] 

XML (extensible Markup Language) is one of the markup 
languages used for describing (marking up) the logical 
structure of a document using simple tags. In XML, 
grammar rules are regulated and logical definitions are 
provided for the components of a document, so that a user 
can uniquely extend the document data. Thus, it is 
anticipated that in the future XML will be used as a data 
format for the exchange of data on the Internet. 

There is a concept for XML called DTD (Document Type 
Definition) , and whether a document is valid for a 
specific DTD can be determined. As a specific example, a 
grammar rule is so regulated that nodes <TITLE>, <AUTHOR> 
and <PUBLISHER> appear, one time each, in the named order, 
under a node <BOOK>. And whether a predetermined document 
is valid, i.e., whether the predetermined document 
conforms to the grammar rule, can be determined. 

As for language style, the structure of an XML document 
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belongs to a class called a tree local language. 
According to the definition for a tree local language, 
data are represented by a labeled tree structure, and the 
correct data for the individual node labels are regulated 
by the regular language of the labels of child nodes. 
That is, in a tree local language, a set of trees that 
belong to a predetermined grammar (regulated by the DTD in 
XML) is determined by the regular language that specifies 
the lists of child nodes of the individual nodes. Another 
tree local language of this type is ASN.l (Abstract Syntax 
Notation 1) . 

There is an increasing trend for XML to be employed for 
writing complicated data structures, for business 
applications and other purposes, that previously could not 
be written using HTML and other resources available to 
networks. It is predicted that with this system it will 
be possible for large XML documents to be exchanged by 
applications . 

Generally, to exchange data or to store it in a database, 
data files are compressed to reduce their sizes and to 
increase transmission efficiency. Therefore, many 

general-purpose data compression techniques, which can be 
employed for a variety of data format types, and many 
specialized data compression techniques, which are 
suitable only for specific data format types, have been 
proposed and can be employed for the exchange of XML 
documents. In respect to compression, it should be noted 
that, while taking into account the data structure of XML 
documents, there is considerable redundant use of tags, so 
that high compression ratios can be expected. 



2 



JP920000016 



[Problems to be Solved by the Invention] 

As is described above, compression of data files is 
generally performed to facilitate the exchange of data and 
to store data in databases. With a tree local language, 
such as XML, high compression ratios can be expected for 
data portions, such as tags, that represent document 
structures . 

Assume that, for data communication, two parties employ a 
grammar G in common and guarantee that they will exchange 
only XML documents that are valid for that grammar. Also 
assume that the grammar rules are so is regulated that the 
nodes <TITLE>, <AUTHOR> and <PUBLISHER> appear, one time 
each, in the named order, under the node <BOOK>. In this 
case, when the recipient of an XML document detects, for 
example, a tag <BOOK> in the XML document, the recipient 
can predict that the first child node will be <TITLE>. 
Therefore, based on this assumption, the tag <TITLE> 
becomes redundant, and a method for encoding the XML 
document to optimize the message length can be devised. 
This applies not only to XML, but also to arbitrary tree 
local languages (e.g., ASN . 1 ) . 

However, conventionally, no compression method has been 
proposed that uses compression to encode the structure 
part of a document in a tree local language. 

It is, therefore, one object of the present invention to 
employ data compression to encode the structure parts of 
documents in tree local languages, such as XML or ASN.l. 

It is another object of the present invention to provide 
for a tree local language a specialized data compression 
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method that is employed with another general-purpose data 
compression technique, so that a high compression ratio 
can be realized. 

[Summary of the Invention] 

To achieve the above objects, according to the present 
invention, a data compression apparatus for encoding data 
and for compressing the encoded data comprises: a grammar 
storage unit for storing grammar rules for a tree local 
language in which data are represented by a labeled tree 
structure; an encoder for reading a document written in 
the tree local language, for dividing the document into a 
structure part and contents, and for encoding the 
structure part using the grammar rules stored in the 
grammar storage unit; and a compressor for compressing the 
contents of the document extracted by the encoder and for 
encoding the compressed contents. The tree local language 
is a tree language in which data are represented by a 
labeled tree structure, and in which, relative to the 
individual node labels, correct data are regulated using 
the regular language used for the child node labels. 

The encoder, includes: a divider for dividing a target 
document into a structure part and contents; an automata 
constructor, for constructing pushdown automata that 
correspond to the grammar rules; and an encoded data 
generator, for employing the pushdown automata that are 
constructed by the automata constructor to perform syntax 
analyzation of the structure part of the document that is 
obtained by the divider, and for generating an encoded 
data string for the structure part. 
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The encoded data generator of the encoder assigns symbols 
to choices resident in the pushdown automata that are 
constructed by the automata constructor. And the encoded 
data generator employs the pushdown automata to analyze 
the structure part of the document written in the tree 
local language, and outputs, at the location of the 
selected choices, the symbols that are assigned for the 
choices, so that the encoded data string for the structure 
part is generated. With this arrangement, the structure 
part of a document written using labels, such as tags, can 
be changed (encoded) into a simple encoded sequence. 
To analyze the structure part of the document using the 
pushdown automata, the tree structure of the document is 
traced in accordance with depth-first searching. That is, 
instead of using ranks that are equally distant from a 
parent node, the relationship between nodes along the 
depth (parental relationship) is employed as a priority to 
trace the tree for the analyzation. 

Furthermore, the compressor performs compression and 
encoding not only for the contents of the document written 
in the tree local language, but also for the structure 
part of the document that is obtained by the encoder. 
While the compression method used by the compressor is not 
especially limited, a conventional general-purpose method 
can be employed. When an encoder obtains a regular data 
string through the encoding of the structure part of a 
document, the encoder can employ a general-purpose method, 
such as PKZIP, to perform compression and encoding for the 
encoded data string, and a high compression ratio can be 
expected. Therefore, it is preferable that the encoded 
data string also be compressed when the contents of the 
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document are compressed. 

Also, when the encoded data string of the structure part 
and the contents of the document are coupled together and 
the resultant data are compressed, the structure part and 
the contents form a single file; and for file management, 
this is preferable . 

According to the present invention, a data communication 
system comprises: a transmission source data processing 
apparatus for transmitting data across a communication 
network; and a transmission destination data processing 
apparatus for receiving the data transmitted across the 
communication network by the transmission source data 
processing apparatus, the transmission source data 
processing apparatus including a first grammar storage 
unit for storing grammar rules for a tree local language 
in which data are represented by a labeled tree structure, 
an encoder for reading a document written in the tree 
local language, for dividing the document into a structure 
part and contents, and for encoding the structure part 
using the grammar rules stored in the first grammar 
storage unit, a compressor for compressing the contents of 
the document extracted by the encoder and for encoding the 
compressed contents, and a transmitter for transmitting 
the structure part encoded by the encoder and the contents 
compressed and encoded by the compressor, and the 
transmission destination data processing apparatus 
including a receiver for receiving data from the 
transmission source data processing apparatus, a second 
grammar storage unit for storing the same grammar rules as 
the grammar rules stored in the first grammar storage unit 
of the transmission source data processing apparatus, a 
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decompressor for employing a decompression method, which 
corresponds to the compression and encoding method used by 
the compressor of the transmission source data processing 
apparatus, to decompress data that are received by the 
receiver and that correspond to the contents of the 
document, and a decoder for employing the grammar rules 
stored in the second grammar rule storage unit to decode 
the data that are received by the receiver and that 
correspond to the structure part of the document. A 
superior manner in which to realize the object of this 
process is for the grammar rules that are prepared to be 
used in common by the data transmission source and the 
destination, because for data communication, a high 
compression ratio can be achieved for a document written 
in a tree local language, and communication efficiency can 
be increased. Since for business communication the 

general rule is for the grammar rules of a tree local 
language to be used in common, the present invention can 
be easily introduced . 



In addition, according to the present invention, a 
database system for storing and managing data in a storage 
unit comprises: a grammar storage unit for storing grammar 
rules for a tree local language in which data are 
represented by a labeled tree structure; an encoder for 
reading a document written in the tree local language, for 
dividing the document into a structure part and contents, 
and for encoding the structure part using the grammar 
rules stored in the grammar storage unit; a compressor for 
compressing the contents of the document extracted by the 
encoder and for encoding the compressed contents; and a 
storage unit for storing the structure part of the 
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document encoded by the encoder, and for storing the 
contents of the document that are compressed and encoded 
by the compressor. 

The compressor performs compression and encoding not only 
for the contents of the document written in the tree local 
language, but also for the structure part of the document 
that is obtained by the encoder. When the encoded data 
string for the structure part and the contents of the 
document are coupled together and the resultant data are 
compressed, the structure part and the contents form a 
single file; and for file management, this is preferable. 

Further, according to the present invention, a data 
compression method for encoding data and for compressing 
the encoded data comprises the steps of: reading a 
document written in a tree local language in which data 
are represented by a labeled tree structure, and dividing 
the document into a structure part and contents; encoding 
the structure part using the grammar rules for the tree 
local language; and compressing the contents of the 
document extracted by the encoder and encoding the 
compressed contents . 

The step of encoding the structure part of the document 
includes the steps of: constructing pushdown automata that 
correspond to the grammar rules; assigning symbols to 
choices resident in the pushdown automata; employing the 
pushdown automata to analyze the structure part of the 
document in accordance with the depth-first searching, and 
to output, at the locations of the choices, the symbols 
that are assigned to the choices; and outputting a symbol 
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string that is obtained by employing the pushdown automata 
as encoded data strings of the structure part of the 
document that is written in the tree local language. With 
this arrangement, the structure part of a document written 
using the labels, such as tags, can be changed (encoded) 
to obtain a simple encoded sequence. 

The data compression method further comprises : a step , to 
be performed before the step of encoding the structure 
part of the document written in the tree logical language 
and when an attribute belongs to a node of a target 
document in the tree local language, of changing the 
attribute to a child node of an element possessing the 
attribute so as to convert the grammar rules of the tree 
local language and the document into a tree structure that 
is to be processed by the pushdown automata. This 
arrangement is preferable because the structure part can 
be encoded using the pushdown automata even when the 
attribute is included in the target document, such as an 
XML document . 

The data compression method further comprises : a step, to 
be performed after the step of encoding the structure part 
of the document, of employing another general-purpose 
compression and encoding method to further compress and 
encode the encoded structure part of the document. This 
arrangement is preferable because a higher compression 
ratio can be expected. 

According to the present invention, provided is a storage 
medium on which input means of a computer stores a 
computer-readable program, the program permitting the 
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computer to perform: a process for reading a document 
written in a tree local language in which data are 
represented by a labeled tree structure, and for dividing 
the document into a structure part and contents; a process 
for encoding the structure part using the grammar rules of 
the tree local language; and a process for compressing the 
contents of the document extracted by the encoder and for 
encoding the compressed contents. With this arrangement, 
all the information processing apparatuses in which this 
program is installed can realize a high compression ratio 
when compressing a document written in the tree local 
language and can achieve high efficiency in communication 
and storage . 

In addition, according to the present invention, a program 
transmission apparatus comprises: storage means for 
storing a program that permits a computer to perform a 
process for reading a document written in a tree local 
language in which data are represented by a labeled tree 
structure, and for dividing the document into a structure 
part and contents, a process for encoding the structure 
part using the grammar rules for the tree local language, 
and a process for compressing the contents of the document 
extracted by the encoder and for encoding the compressed 
contents; and transmission means for reading the program 
from the storage means, and for transmitting the program. 
With this arrangement, all the information processing 
apparatuses that have downloaded this program from the 
program transmission apparatus and installed it can 
realize a high compression ratio when compressing a 
document written in the tree local language and can 
achieve high efficiency in communication and storage. 
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[Preferred Embodiment] 

The preferred embodiment of the present invention will now 
be described in detail while referring to the accompanying 
drawings . 

Fig. 1 is a diagram for explaining the general arrangement 
of a document compression system according to the 
embodiment. In Fig. 1, an encoder 11 divides a target 
document into a structure part and contents, and encodes 
the structure part using a grammar rule 12 that is stored 
in a predetermined storage device. A compressor 13 
comprises a structure part encoded by the encoder 11 , and 
the contents of the document. A decompressor 21 

decompresses the document compressed by the compressor 13. 
At the time whereat the document is decompressed by the 
decompressor 21, the document is separated into the 
contents and the structure part encoded by the encoder 11. 
A decoder 23 reconstructs the encoded structure part by 
using a grammar rule 22 that is stored in a predetermined 
storage device, and combines the structure part and the 
contents to reproduce the document. 

When the method of the embodiment is employed for data 
compression for data communication, the encoder 11 and the 
compressor 13 are provided on the transmission side, and 
the decompressor 21 and the decoder 23 are provided on the 
reception side. And when the method of the embodiment is 
employed to compress a data file to be stored in a 
database system, in accordance with the data transmission, 
the encoder 11 functions as the decoder 23, and the 
compressor 13 functions as the decompressor 21. 

An explanation will now be given for an example wherein 
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XML is employed as a target tree local language. 
Fig. 2 is a diagram for explaining the data compression 
processing according to this embodiment. In the data 
compression processing in Fig. 2, first, a target XML 
document 201 is read by the encoder 11, and is divided 
into a structure part 202 and contents 204. The structure 
part 202 includes the tree structure, the tag names and 
the attribute names of the XML document 201, and the 
contents 204 comprise # PC DATA and the attribute values of 
the XML document 201. The XML document 201 is divided 
into the structure part 202 and the contents 204 because 
generally the structure part 202 and the contents 204 have 
quite different statistical deviations, and independently 
compressing the two is efficient. 

The structure part 202 obtained by dividing the XML 
document 201 is encoded by the encoder 11, and for this 
encoding, the grammar rule 12 is employed. Since in this 
embodiment the XML document 201 is the target, the grammar 
rule 12 is regulated by the DTD. This encoding processing 
will be described in detail later. The, an obtained 
encoded data string 203 and the contents 204 are 
transmitted to the compressor 13. 

Finally, the compressor 13 compresses and encodes the 
encoded data string 203 and the contents 204, and combines 
the obtained data to generate a compressed XML document 
205. For the encoding process, a conventional, well known 
method, such as LZ77, is employed by the compressor 13. 
At this time, the compressor 13 is mainly used to perform 
compression and encoding for the contents 204. However, a 
general-purpose compression and encoding method, such as 
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PKZIP, can effectively be used for the encoded data string 
2 03 . As will be described later, in this embodiment, the 
encoded data string 203 is output as a numerical sequence. 
Therefore, if the data is a sequence of comparatively 
regular numerals, a high compression ratio can be 
expected. Thus, the compressor 13 can compress and encode 
the encoded data string 203 with the contents 204 . It 
should be noted, however, that the compression of the 
encoded data string 203 by the compressor 13 is an 
arbitrary process. The encoded data string 203 and the 
contents 204, rather than being compressed by the 
compressor 13, may either be simply correlated with each 
other or be coupled together, and may be exchanged or may 
be stored in a storage device. 

As is described above, in this embodiment, the structure 
part 202 of the XML document 201 is compressed using the 
method of this invention, and further, the encoded 
structure part 202 and contents 204 are compressed using a 
conventional method. Thus, the data compression method of 
this embodiment is employed in conjunction with various 
conventional compression methods. 

To decompress the thus compressed XML document 205, the 
above compression processing is performed invertedly. 
Specifically, the decompressor 21 decompresses the encoded 
data string 203 and the contents 204 using a method that 
corresponds to the compression and encoding method used by 
the compressor 13. Then, as will be described later in 
detail, the decoder 23 reconstructs the decompressed 
encoded data string 203 using the grammar rule 22, which 
is identical to the grammar rule 12 and which is regulated 
by the DTD. Then, the XML document 201 is reproduced 
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using the structure part 202, which is obtained during the 
decoding process, and the contents 204, which are 
decompressed by the decompressor 21. 

A detailed explanation will now be given for the 
processing, performed according to the embodiment, used to 
encode the structure part of the XML document. 
To simplify the explanation, for this processing a target 
XML document does not include any attributes, and the 
overall actual body of the XML document are developed. 
How to handle attributes will be discussed later. 

Fig. 3 is a functional block diagram for explaining the 
arrangement of the encoder 11 that encodes the structure 
part of the XML document. In Fig. 3, the encoder 11 
comprises: a divider 111, for dividing the target XML 
document 201 into the structure part 202 and the contents 
204; an automata constructor 112, for employing the 
grammar rule 12 to construct pushdown automata that will 
be described later; and an encoded data string generator 
113, for generating the encoded data string 203 for the 
structure part 202 by employing, as an encoding 
transducer, the pushdown automata that are constructed by 
the automata constructor 112. 

Fig. 4 is a diagram showing an example target XML 
document. The contents of the XML document consist of the 
list of character strings at the portion of a contents 
model that corresponds to # PCDATA. That is, the contents 
of the XML document in Fig. 4 are a list consisting of 
four character strings, "Stringl, " "String2, " "String3" 
and "String4." This list can be represented compactly 
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using, for example, the following byte string in which 
character strings terminated by a null character are 
arranged ("¥0" represents a null character). 
"Stringl¥0String2¥0String3¥0String4¥0" 

This character string is compressed and encoded separately 
from the structure part, as described above. 

The structure part of the XML document in Fig. 4 is shown 
in Fig. 5. This structure part is obtained by replacing 
the character strings that correspond to the contents of 
the XML document in Fig. 4 with place holders (□) . 

In this embodiment, the divider 111 of the encoder 11 
extracts the structure part in Fig. 5 from the XML 
document shown in Fig. 4, the automata constructor 112 
constructs the pushdown automata using grammar rule 12, 
and the encoded data string generator 113 encodes the 
structure part using the pushdown automata. Fig. 6 is a 
diagram showing an example DTD used to regulate the 
grammar rule 12 . 

After the divider 111 has performed the division process, 
in order to perform encoding using the grammar rule 12, 
the automata constructor 112 constructs the pushdown 
automata that correspond to the DTD. According to the DTD 
in Fig. 6, when an element A appears, it means that one 
each of an element B and an element C will appear in the 
named order, and the state shifting is thereafter 
terminated. Similarly, when the element B appears, it 
means that one element D will appear, and the state 
shifting is thereafter terminated. When the element C 
appears, it means that 0 or more elements E or elements F 
will appear, and the state shifting is thereafter 
terminated. When the element E appears, it means that one 
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element G or one element H will appear, and the state 
shifting is thereafter terminated. 

Fig. 7 is a diagram showing the natural pushdown automata 
that correspond to the DTD in Fig. 6. Since non-terminal 
symbols D and G are obvious rules having only the terminal 
symbol # PC DATA, they are not shown. 

The automata can be constructed, without any ambiguity, 
for the individual non-terminal symbols of the grammar. 
Therefore, when the embodiment is applied for data 
communication, the same pushdown automata can be 
constructed by employing the DTD that is used in common by 
the transmission side and the reception side. 

Generally, the pushdown automata are used to analyze the 
syntax of an input string. In this sense, the pushdown 
automata receive all the symbol strings on the surface 
layer, i.e., all the strings acquired by arranging one or 
more # PCDATA (or place holders "□") . However, as the 
obtained syntax analyzation tree, for example, a node B 
and a node C must appear in the named order as the 
children of a node A. In addition, following the element 
C, the empty state is shifted to the final state. As is 
described above, the pushdown automata can be used to 
determine whether the syntax analyzation tree for the 
analyzed XML document (e.g., a DOM tree) satisfies the 
grammar . 

An explanation will now be given for the processing 
performed to examine the grammar using the pushdown 
automata, while employing the syntax tree in Fig. 8 as an 
example. In Fig. 8, # PCDATA at each leaf is not shown. 
In order to determine whether this syntax tree can be 
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generated by a grammar regulated by the DTD in Fig. 6, it 
is only necessary for each node of the syntax tree to 
determine whether a string consisting of its child nodes 
can be accepted by the automata that correspond to the 
non-terminal symbol of the node. For example, an element 
A as it child nodes a string BC . The child nodes are 
received by the automata that correspond to the 
non-terminal symbol A (see A in Fig. 7). Therefore, it is 
found that this portion satisfies the grammar. When all 
the nodes are traversed (traced according to the 
depth-first searching) in the same manner in the Preorder 
by using the corresponding automata, the grammar checking 
is terminated. 

This usage of the pushdown automata for the syntax 
analyzation tree is called a validity examination in the 
following explanation. It should be noted that the 

automata that correspond to each non-terminal symbol used 
in the above process are the minimum decisive automata, 
except for the shifting of the c to the final state. 

The automata constructor 112 converts the pushdown 
automata in Fig. 7 into a transducer that encodes the 
structure part of the XML document (see Fig. 5), i.e., 
automata for the analyzation of the syntax of a character 
string . 

In the pushdown automata in Fig. 7, assume that an entry 
is a string consisting of four #PCDATAs (or place holders 
"□") and that the analyzation process is initiated while 
using A as the start symbol. Then, a node A, a node B and 
a node D are generated in order, and the first # PCDATA is 
recognized. When a node C is generated, three choices are 
available: a node E can be generated, a node F can be 
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generated, or the state shifting can be terminated at the 
node C and returned to the upper node. Numbers 1, 2 and 3 
are assigned to the three choices in consonance with the 
alphabetical order of the labels (label s is always 
determined as being the last) . Similarly, since the first 
state of the node E provides two choices, either a node G 
can be generated or a node H can be generated, numbers 1 
and 2 are assigned to these choices. In this embodiment, 
numbers are assigned to the choices, but the symbols that 
can be used to identify the choices are not limited to 
numbers. Arbitrary symbols, such as alphabetical 

character or signs, may be employed to designate the 
choices . 

Fig. 9 is a diagram showing an encoding transducer that is 
produced by the conversion of the pushdown automata in 
Fig. 7. 

The encoded data string generator 113 of the encoder 11 
operates an encoding transducer that is constructed by the 
automata constructor 112. 

When the validity examination (the application of the rule 
in the Preorder) is performed, the encoding transducer in 
Fig. 9 outputs a corresponding choice number. 
Specifically, in Fig. 9, there are no choices for the 
rules A, B, F and H, the encoding transducer outputs 
nothing. However, when the rule C and the rule E are 
employed, the encoding transducer outputs pertinent 
numbers. For example, when the validity examination is 
performed for the syntax tree in Fig. 8, as the encoding 
transducer traces the tree it outputs the numbers shown in 
Fig. 10. 

Through the above processing, a number string "112123" is 



18 



JP920000016 



obtained, which strictly regulates the movement of the 
pushdown automata. Therefore, the number string can be 
employed as the encoded data string of the structure part 
(Fig. 5) of the XML document in Fig. 4. 

The processing for decoding the structure part of the XML 
document according to the embodiment will now be 
described. 

To decode the XML document, which is encoded through the 
above processing, only the input/output of the encoding 
transducer need be inverted. Therefore, the decoder 23 
employs the same pushdown automata as in Fig. 7 to 
generate a decoding transducer, and begins the decoding 
process. As is described above, since automata can be 
constructed, without any ambiguity, for each non-terminal 
symbol of the grammar, if the grammar rule 12 regulated by 
the DTD is the same as the grammar rule 22, the decoder 23 
can construct exactly the same pushdown automata as those 
in Fig . 7 . 

Fig. 11 is a diagram showing a decoding transducer that is 
produced by the conversion of the same pushdown automata 
as those in Fig. 7. In the decoding transducer in Fig. 
11, "i/B" represents the shift that "when an input 
character string "i" appears, the rule B is called and 
thereafter the state is shifted to the next." Thus, a 
number string from the encoder 11 is input, and a 
corresponding syntax analyzation tree is generated. 
When the number string "11212 3" described above is 
entered, based on the assignment of the original numbers, 
the pushdown automata (the decoding transducer) can, 
without any ambiguity, accept the encoded number string 
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for the XML document. Therefore, the generated syntax 
analyzation tree is the same as the original syntax 
analyzation tree in Fig. 8. As a result, the structure 
part of the XML document can be reproduced. 

The handling of attributes will now be described. 
In this embodiment, an attribute is converted to a tree 
structure so that it can be processed by the pushdown 
automata. Specifically, all the elements (ELEMENTS) 

having attributes are changed so that the attributes are 
regarded as child nodes. At this time, the attributes 
appear in the alphabetical order of their names. The 
attribute #REQUIRED is arranged unchanged, and the 
attribute #IMPLIED is arranged with an option "?." Since 
originally no information is provided for the attribute 
#FIXED, it is not included in the DTD obtained by the 
conversion . 

Fig. 12 is a diagram showing a comparison of the states of 
a predetermined DTD obtained before and after the 
conversion. In Fig. 12, the DTD on the left is converted 
into the form shown on the right. 

For the XML document that includes attributes, the 
attributes are also converted to elements in accordance 
with the DTD. Fig. 13 is a diagram showing a comparison 
of the states of a predetermined XML document before and 
after the conversion. 

After the DTD and the XML document are changed, in the 
above manner, to the state where no attribute is provided, 
the encoding and decoding processing described above are 
performed. It should be noted that the conversion of the 
DTD may be performed in advance before the pushdown 
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automata are constructed, or may be performed as needed 
after the pushdown automata have been constructed. In the 
first case, a new DTD obtained by the conversion is 
employed to construct the pushdown automata. In the 
second case, the original DTD (which had attributes) is 
employed to construct the pushdown automata. 

As is described above, according to this embodiment, it is 
inevitable that both the XML document compression side and 
the decompression side shall employ the same DTD in 
common. Therefore, when the data compression method of 
the embodiment is employed for data communication, the 
same DTD must be prepared for the transmission side data 
processing apparatus and the reception side data 
processing apparatus . 

Fig. 14 is a diagram for explaining the configuration of a 
data communication system that employs the embodiment. In 
a data processing apparatus 1410 on a transmission side, 
the encoder 11 receives an XML document from a data 
processor, and employs a DTD 1411 (corresponding to the 
grammar rule 12 in Fig. 1) to encode the structure part. 
The compressor 13 compresses the encoded structure part 
and the contents, and a transmitter 1412 transmits to a 
reception side, via a communication network, the resultant 
XML document produced by the encoding performed by the 
encoder 11 and the compression performed by the compressor 
13 in the data processing apparatus 1420. In the data 
processing apparatus 1420 on the reception side, a 
receiver 1422 receives data via the communication network 
and transmits them to the decompressor 21. At this time, 
the decompressor 21 decompresses the received data and the 
contents of the XML document are recovered. The decoder 



21 



JP920000016 



23 then employs a DTD 1421 (corresponding to the grammar 
rule 22 in Fig. 1) to decode the encoded data string for 
the structure part of the data that have been 
decompressed. The decoder 23 then reassembles the 

obtained structure part and the contents to reproduce the 
XML document, and transmits the XML document to a data 
processor. During this processing, the DTD 1411 in the 
transmission side data processing apparatus 1410 has the 
same contents as the DTD 1421 in the reception side data 
processing apparatus 1420 . 

When an XML document is exchanged by applications that are 
employed for business communications, such as during the 
course of an electronic business transaction, in most 
cases, by mutual consent, a DTD is established in advance. 
Therefore, with the assumption that DTDs will be used in 
common, the embodiment can be applied for business 
communications . 

When the method of this embodiment is employed to compress 
a data file to be stored by a database system, to decode 
the structure part of an XML document, the DTD that was 
used to encode the structure part can be employed 
unchanged for decoding it, so that whether or not a DTD is 
used in common does not have to be taken into account. 
Fig. 15 is a diagram for explaining the configuration of a 
database system that employs the embodiment. In a 

database system 1500, an encoder 11 receives an XML 
document from a data processor, and employs a DTD 1501 
(corresponding to the grammar rule 12 in Fig. 1) to encode 
the structure part. A compressor 13 then compresses the 
encoded structure part and the contents. After the XML 
document has been encoded by the encoder 11 and compressed 
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by the compressor 13 it is stored in a storage device 
1502. To read the XML document from the storage device 
1502, the compressor 13 functions as the decompressor 21 
and the encoder 11 functions as the decoder 23, and the 
DTD 1501 used for encoding the structure part of the XML 
document is employed for decoding it. 

In the above explanation, the XML language is used as the 
tree local language. However, the embodiment can be 
employed for another tree local language, such as ASN.l. 
In this case, however, grammar rules, such as the DTD for 
XML, must also be used in common by the data file 
compression side and the decompression side. 

[Advantages of the Invention] 

As is described above, according to the present invention, 
data compression can be performed to encode the structure 
part of a document in a tree local language. 

Furthermore, since a data compression method is specially 
adapted for a tree local language and is employed with 
another general-purpose data compression technique, a data 
compression method that provides a high compression ratio 
can be employed. 

3. Brief Description of the Drawings: 

Fig. 1 is a diagram for explaining the general arrangement 
of a document compression system according to one 
embodiment of the present invention. 

Fig. 2 is a diagram for explaining the data compression 
processing according to the embodiment. 

Fig. 3 is a diagram for explaining the arrangement of an 
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encoder according to the embodiment. 

Fig. 4 is a diagram showing an example target XML document 
according to the embodiment. 

Fig. 5 is a diagram showing the structure part of the XML 
document in Fig . 4 . 

Fig. 6 is a diagram showing an example grammar rule used 
for the embodiment . 

Fig. 7 is a diagram showing pushdown automata that are 
constructed in accordance with the grammar rule in Fig. 6. 
Fig. 8 is a diagram showing an example syntax tree for 
explaining the grammar checking method that uses the 
pushdown automata . 

Fig. 9 is a diagram showing an encoding transducer that is 
generated by using the pushdown automata in Fig. 7. 
Fig. 10 is a diagram showing example results obtained by a 
validity examination performed for the syntax tree in Fig. 
8 . 

Fig. 11 is a diagram showing a decoding transducer that is 
generated by using the same pushdown automata as in Fig. 
7 . 

Fig. 12 is a diagram for explaining the state wherein a 
DTD that has attributes is converted into a DTD that has 
no attributes. 

Fig. 13 is a diagram for explaining the state wherein an 
XML document that has attributes is converted into an XML 
document that has no attributes. 

Fig. 14 is a diagram for explaining the structure when the 
embodiment is applied for a data communication system. 
Fig. 15 is a diagram for explaining the structure when the 
embodiment is applied for a database system. 

[Description of the Symbols] 
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11: Encoder 

12, 22: Grammar rule 

13 : Compressor 

2 1 : Decompressor 

23: Decoder 

201: XML document 

202: Structure part 

203: Encoded data string 

204 : Contents 

205: Compressed XML document 

4. Claims: 
Claim 1 

A data compression apparatus for encoding data and for 
compressing the encoded data comprising: 

a grammar storage unit for storing grammar rules for 
a tree local language in which data are represented by a 
labeled tree structure; 

an encoder for reading a document written in said 
tree local language, for dividing said document into a 
structure part and contents, and for encoding said 
structure part using said grammar rules stored in said 
grammar storage unit; and 

a compressor for compressing said contents of said 
document extracted by said encoder and for encoding the 
compressed contents . 

Claim 2 

The data compression apparatus according to claim 1, 
wherein said encoder includes: 

a divider for dividing a target document into a 
structure part and contents; 
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an automata constructor , for constructing pushdown 
automata that correspond to said grammar rules; and 

an encoded data generator, for employing said 
pushdown automata that are constructed by said automata 
constructor to perform syntax analyzation of said 
structure part of said document that is obtained by said 
divider, and for generating an encoded data string for 
said structure part. 



Claim 3 

The data compression apparatus according to claim 2, 
wherein said encoded data generator of said encoder 
assigns symbols to choices resident in said pushdown 
automata that are constructed by said automata 
constructor; and wherein said encoded data generator 
employs said pushdown automata to analyze said structure 
part of said document written in said tree local language, 
and outputs, at the location of the selected choices, said 
symbols that are assigned for said choices, so that the 
encoded data string for said structure part is generated. 



Claim 4 

The data compression apparatus according to claim 1, 
wherein said compressor performs compression and encoding 
not only for said contents of said document written in 
said tree local language, but also for said structure part 
of said document that is obtained by said encoder. 



Claim 5 

A data communication system comprising: 

a transmission source data processing apparatus for 
transmitting data across a communication network; and 
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a transmission destination data processing apparatus 
for receiving said data transmitted across said 
communication network by said transmission source data 
processing apparatus, 

said transmission source data processing apparatus 
including 

a first grammar storage unit for storing grammar 
rules for a tree local language in which data are 
represented by a labeled tree structure, 

an encoder for reading a document written in 
said tree local language, for dividing said document into 
a structure part and contents, and for encoding said 
structure part using said grammar rules stored in said 
first grammar storage unit, 

a compressor for compressing said contents of 
said document extracted by said encoder and for encoding 
the compressed contents, and 

a transmitter for transmitting said structure 
part encoded by said encoder and said contents compressed 
and encoded by said compressor, and 

said transmission destination data processing 
apparatus including 

a receiver for receiving data from said 
transmission source data processing apparatus, 

a second grammar storage unit for storing the 
same grammar rules as said grammar rules stored in said 
first grammar storage unit of said transmission source 
data processing apparatus , 

a decompressor for employing a decompression 
method, which corresponds to the compression and encoding 
method used by said compressor of said transmission source 
data processing apparatus, to decompress data that are 
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received by said receiver and that correspond to said 
contents of said document, and 

a decoder for employing said grammar rules 
stored in said second grammar rule storage unit to decode 
the data that are received by said receiver and that 
correspond to said structure part of said document. 

Claim 6 

A database system for storing and managing data in a 
storage unit comprising: 

a grammar storage unit for storing grammar rules for 
a tree local language in which data are represented by a 
labeled tree structure; 

an encoder for reading a document written in said 
tree local language, for dividing said document into a 
structure part and contents, and for encoding said 
structure part using said grammar rules stored in said 
grammar storage unit; 

a compressor for compressing said contents of said 
document extracted by said encoder and for encoding the 
compressed contents; and 

a storage unit for storing said structure part of 
said document encoded by said encoder, and for storing 
said contents of said document that are compressed and 
encoded by said compressor. 



Claim 7 

The database system according to claim 6, wherein said 
compressor performs compression and encoding not only for 
said contents of said document written in said tree local 
language, but also for said structure part of said 
document that is obtained by said encoder. 
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Claim 8 

A data compression method for encoding data and for 
compressing the encoded data comprising the steps of: 

reading a document written in a tree local language 
in which data are represented by a labeled tree structure, 
and dividing said document into a structure part and 
contents ; 

encoding said structure part using said grammar rules 
for said tree local language; and 

compressing said contents of said document extracted 
by said encoder and encoding the compressed contents. 

Claim 9 

The data compression method according to claim 8, wherein 
said step of encoding said structure part of said document 
includes the steps of: 

constructing pushdown automata that correspond to 
said grammar rules; 

assigning symbols to choices resident in said 
pushdown automata ; 

employing said pushdown automata to analyze said 
structure part of said document in accordance with the 
depth-first searching, and to output, at the locations of 
said choices, said symbols that are assigned to said 
choices; and 

outputting a symbol string that is obtained by 
employing said pushdown automata as encoded data strings 
of said structure part of said document that is written in 
said tree local language. 

Claim 10 

The data compression method according to claim 9, further 
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comprising : 

a step, to be performed before said step of encoding 
said structure part of said document written in said tree 
local language and when an attribute belongs to a node of 
a target document in said tree local language, of changing 
said attribute to a child node of an element possessing 
said attribute so as to convert said grammar rules of said 
tree local language and said document into a tree 
structure that is to be processed by said pushdown 
automata . 



Claim 11 

The data compression method according to claim 8, further 
comprising: a step, to be performed after said step of 
encoding said structure part of said document, of 
employing another general-purpose compression and encoding 
method to further compress and encode said encoded 
structure part of said document. 

Claim 12 

A storage medium on which input means of a computer stores 
a computer- readable program, said program permitting said 
computer to perform: 

a process for reading a document written in a tree 
local language in which data are represented by a labeled 
tree structure, and for dividing said document into a 
structure part and contents; 

a process for encoding said structure part using said 
grammar rules of said tree local language; and 

a process for compressing said contents of said 
document extracted by said encoder and for encoding the 
compressed contents . 
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Claim 13 

A program transmission apparatus comprising: 

storage means for storing a program that permits a 
computer to perform 

a process for reading a document written in a 
tree local language in which data are represented by a 
labeled tree structure, and for dividing said document 
into a structure part and contents, 

a process for encoding said structure part using 
said grammar rules for said tree local language, and 

a process for compressing said contents of said 
document extracted by said encoder and for encoding the 
compressed contents; and 

transmission means for reading said program from said 
storage means, and for transmitting said program. 
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[ Document Type ] Abstract 

[Abstract] 

[Object] 

It is one object of the present invention to perform data 
compression to encode the structure part of a document in 
a tree local language, such as XML or ASN . 1 . 
[Constitution] 

A data compression apparatus for encoding data and for 
compressing the encoded data comprises: a grammar rule 12 
for a tree local language in which data are represented by 
a labeled tree structure; an encoder 11 for reading a 
document written in the tree local language, for dividing 
the document into a structure part and contents, and for 
encoding the structure part using the grammar rule 12; and 
a compressor 13 for compressing the contents of the 
document extracted by the encoder 11, and for encoding the 
compressed contents . 
[Selected Drawing] Fig. 1 
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<?xml version="1. 0"?> 

<!D0CTYPE department SYSTEM "sample. dtd"> 
<A> 
<B> 

<D>String1</D> 
</B> 
<C> 

<E> 

<G>String2</G> 
</E> 
<F> 

<G>String3</G> 
</F> 
<E> 

<H> 

<G>String4</G> 
</H> 
</E> 
</C> 
</A> 



Fig. 4 
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<?xml version="1.0"?> 

<!DOCTYPE department SYSTEM "sample. dtd"> 
<A> 
<B> 

<D>D</D> 
</B> 
<C> 
<E> 

<G>n</G> 
</E> 
<F> 

<G>D</G> 
</F> 
<E> 
<H> 

<G>D</G> 
</H> 
</E> 
</C> 
</A> 



Fig. 5 



<ELEMENT A (B, C)> 
<ELEMENT B (D)> 
<ELEMENT G (E|F)*> 
<ELEMENT E (G|H)> 
<ELEMENT F (G)> 
<ELEMENT H (G)> 
<ELEMENT D (#PCDATA)> 
<ELEMENT G (#PCDATA)> 



Fig. 6 
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Fig. 9 
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XML document 



Before conversion 


After conversion 


<depart«ent ser iaJNo="01 2345" ttianager =,, yes"> 

<name>aaaaa(/naine> 

<emai l>mai (^address- com</e»aH> 
</department> 


department 

<serialNo>012345</serialNo> 

<»afiager>yes(/manager> 

<name>aaaaa</naie> 

<enai Draai l«address. coiK/emai I> 
</department> 
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if any 




Inventor's signature 

2-22-14-2F Haramachida, Machida-shi, 


Tokyo Japan 


Date 


Residence 
Japanese 



Citi zenship 
Same as above. 



Post Office Address 



Naohiko Uramoto 



Full name of third joint-inventor, if any 



Inventor's signature 
5-22-1-211 Nara, Aoba-ku, Yokohama-shi, Kanaqawa Japan 



"Residence 
[ Japanese 



\Citi zenship 

..- Same as above . 



Post Office Address 



Full name of fourth joint-inventor, if any 



: Inventor's Signature 



Residence 



Citi zenship 
Same as above. 



Post Office Address 



Full name of fifth joint inventor, if any 



Inventor's Signature 



Residence 



Citi zenship 
Same as above . 



Post Office Address 



Full name of sixth joint-inventor, if any 



Inventor's signature Date 



Residence 



Citizenship 
Same as above 



Post Office Address 



